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Abstract—One goal of the Industry 4.0 initiative is to improve 
horizontal and vertical knowledge sharing among industri 
Horizontal sharing allows companies to exchange knowledge 
across different sites whereas vertical sharing allows the exchange 
of knowledge across hierarchical structures within a site. Sharing 
knowledge especially about incidents results in better products, 
reduces down-times and improves efficiency in industries. Hori- 
zontal and vertical knowledge sharing is a great challenge in the 
domain of manufacturing. We describe a case study where we 
replace handwritten incident and maintenance documentation. 
‘The main problems associated with handwritten documentation 
are bad readability and non-shareability. 

In this paper we describe our Incident Localization and Assis- 
tance System (ILAS), an incident documentation and mainte- 
nance system. ILAS transfers process oriented incident manage- 
ment knowledge from IT Service Management (ITSM) to the 
domain of manufacturing. ILAS offers real-time monitoring using 
wearables, incident analysis support and knowledge sharing for 
incidents within and among different production sites. We imple- 
mented ILAS as a Cyber-Physical Human System. Additionally, 
we conducted a survey about the potential of wearables within 
Industry 4.0. We found out that wearables in enterpri ill 
in their infancy but have great potential especially for th 
case. 


I. INTRODUCTION 


Incident Management (IcM) is part of the IT Service 
Management Process with the goal to restore a service as 
fast as possible without influencing business operations [1]. To 
achieve this goal the detection, the analysis and the solution 
of an incident must be fast and efficient [2]. Vertical as 
well as horizontal knowledge sharing among all included 
stakeholders amplifies efficiency within IcM. For ITSM several 
standards are (commercially) available focusing on processes 
and characteristics (such as ITIL!). Basically, ITSM focuses 
on the identification of activities, clear definition of interfaces 
between the included parties, well defined roles and respon- 
sibilities as well as measurable quantities such as time and 
performance. The idea is to be process-oriented, following a 
standardized process, being solution-oriented and to improve 
efficiency and effectiveness minimizing risk at any level. 

With our proposed system we want to transfer ITSM knowl- 
edge to the domain of manufacturing. We claim that with the 
help of hardware and software technologies in this domain 
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IcM’s efficiency and effectiveness can be improved. The inte- 
gration of wearables within industrial environments to increase 
productivity has already been proven [3]. Communication, 
monitoring activities, documentation and managing are still 
big issues especially in the domain of manufacturing. As 
soon as an incident that requires human intervention occurs, a 
maintenance request is published to the maintenance experts, 
generated by the Distributed Control System (DCS). Due to 
complexity of industrial plants, maintenance experts need to 
deal with a lot of documentation before, during and after the 
replacement of automation devices. Due to the plants” life 
cycle, such documentation needs to last up to 50 years [4] 
and can either be stored computer based or paper based (ring 
binders). Usually, in industries it is a combination of both. 
Using technology in a reasonable way we want to excel current 
incident management, which is yet in many cases paper based. 
Incidents in our understanding are any occurrences within a 
production line. Typically, it is a malfunction of a hardware 
component in a certain module of the plant. 

A goal of the Industry 4.0? initiative is the integration of such 
technology in combination with vertical and horizontal know|- 
edge distribution and sharing. We focus on the integration of 
technology and information systems on top of an industrial 
production site. We want to support experts in their daily tasks, 
to facilitate knowledge sharing among different stakeholders 
and to offer detailed monitoring mechanisms to the production 
site management. 

To achieve that goal we have to bridge the cyber and physical 
world to support factory experts in their daily routines and 
tasks. In this paper we describe the development and the 
implementation of a Cyber-Physical Human System (CPHS). 
It offers a real-time incident monitoring and management by 
using wearables in combination with smart phones and a 
Bluetooth low energy (BLE) based tracking technology. For the 
requirements analysis we brought together electrical engineers, 
mechanical engineers and software engineers each synergizing 
with their domain specific knowledge. We are following the 
paradigm of interdisciplinary cooperation, which is inevitable 
to develop Cyber-Physical (Human) Systems in the domain of 
manufacturing. 

In Section IT we summarize related work correlating with 
our proposed system. Section III describes the results of our 
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Fig. 1: Developed Incident Management Lifecycle (IML): Red background shows the incident identification automatically 
done by a Condition Monitoring System or being manually triggered by an operator via web frontend. Orange background 
highlights the steps that are performed by a production site expert using a smart phone in combination with the smart glove. 
Green background highlights the actual solution process done by a technical expert. 


conducted foresight which estimates the potential of wearables 
within enterprises. Section IV describes the problem we ad- 
dress followed by Section V that offers an insight into our 
implemented architecture and our system design. Section VI 
summarizes our work. 


II. CYBER-PHYSICAL SYSTEMS, INTERNET OF THINGS 
AND INCIDENT MANAGEMENT 


Cyber-Physical (Human) Systems (CPHS) are a new gen- 
eration of systems that can monitor and control the cyber as 
well as the physical environment. They make use of sensors 
and actuators and can integrate humans as information and 
actuation source. 

Within the Internet of Things (IoT) many different devices 
can offer information of any kind. Such a variety of infor- 
mation can contribute and be used to improve information 
transparency. As a consequence, information transparency can 
improve efficiency and operational safety within a certain 
domain as well as among different domains. A CPHS can 
make use of IoT technology in terms of actual oT hardware as 
well as loT protocols. For ILAS we use Bluetooth 4.0 devices 
such as smart phones and wearables using the Intel Edison. 
We adapt IoT software protocols and patterns to implement a 
scalable, lightweight CPHS. 

Io devices have to deal with limited resources, such as bat- 
tery lifetime, limited bandwidth and heterogeneous hardware 
and software platforms. Therefore, a lightweight and reliable 
internet protocol that is optimized for resource limited devices 
such as single-board computers is needed. Three prominent ex- 
amples are the Message Queue Telemetry Transport (MQTT)*, 
MQTT-S [5] and the Constraint Application Protocol (CoAP)*. 
‘Those three protocols are used in Wireless Sensor Networks 
(WSNs) [5] and IoT applications. We want to transfer [oT 
knowledge and technology to create a CPHS. 

In literature, performance evaluations between MQTT and 
CoAP have been conducted [6] [7] [8] [9]. These evaluations 
focus on power consumption, bandwidth utilization, reliability, 
delay and payload size. The evaluations show that in scenarios 
with high message payload in combination with unreliable 
network infrastructure, MQTT is more applicable and excels 
CoAP. Due to the existing evaluations we used MQTT to 
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guarantee a reliable communication among the included de- 
vices as it uses the TCP stack. Frameworks already exist that 
combine RESTful services over HTTP with the mentioned 
protocols (Quest [10], Ponte [11] and OASIS5). However, 
we implemented our own framework as we want to keep 
our system architecture flexible and stay independent, being 
aware of existing heterogeneous industrial IT-Architectures and 
different PLCs, DCSs and MESs vendors. Our framework will 
gather information from standard industrial components such 
as Programmable Logic Controllers (PLCs), Distributed Con- 
trol Systems (DSCs) and Manufacturing Execution Systems 
(MES), to support maintenance experts in their daily tasks and 
routines. 

Research concerning wearables is done in the fields of edu- 
cation, energy, health, sports fashion, wellness and manufac- 
turing. With our case study we focus on the manufacturing 
domain. In this domain gloves are an accepted and frequently 
used wearable. Gloves in combination with RFID have already 
been part of research [12]. For our case study we cooperated 
with ProGlove, a start-up that is currently developing a smart 
glove. Together with them we used and extended the developed 
smart glove regarding our requirements, especially the software 
part. We benefit from their electrical engineering expertise and 
combine it with our software engineering know-how. 
Incident detection, identification and localization are receiving 
high attention in the domain of manufacturing. Related key 
words in this area are, ic. Plant Asset Management (PAM), 
Condition Monitoring (CM), Predictive Maintenance (PM) and 
Fault Detection/Isolation (FDI). To the best of our knowledge, 
incident management integrating wearables within the domain 
of manufacturing has not been developed as in ILAS. Research 
institutes exist, that are focusing on the applicability of mobile 
devices such as tablets or mobile phones and the corresponding 
gestures for touch interaction such as [17], but do not use the 
potential of wearables for ICM. 


Ill. Survey 


We conducted a prognosis to anticipate the change within 
the market of wearables. Typically, such change is an evo- 
lutionary process and takes place with a repeated and per- 
sistent occurrences of early warning signals. Currently, those 
signals are very prominent in media, literature and research. 
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Aa i: 


(a) What is the percentage of the enterprises in 
Germany that will use wearables in the following 
years in their operational environment? 


Fig. 2b for Transport & Logi 


and for Security Sensitive Environments: 288 answers have been given; 


(b) Estimate the potential of each sector for the up- 
coming 5 years concerning the usage of wearbales 
in operational environments, 


(©) Estimate the percentage of professionals in 
cach use case that will use wearables during their 
daily operations until 2018, 


ig. 2: Smart Glove results: Fig. 2a for the year 2016: 382, 2018: 377 and for the year 2020: 373 answers have been given. 
291, Maintenance: 287, Manufacturing: 287, Facility Management: 287, Health Care: 292 


2c Load-Master: 294, Printer Maintenance: 294 and 


Smart Glove: 295 answers have been given. Due to space reasons the x-ticks of Fig. 2b have been shortend. 


To estimate the potential of wearables we conducted this 
foresight using the prognosis market technique at ‘T-Systems 
International GmbH, as we believe that our proposed [LAS 
has great potential in the field of manufacturing. 

Foresights claim to be a cost-efficient systematic process 
being able to detect changes in markets and environments 
by acquiring information from a large number of people 
[18]. Prognosis markets can gather information from groups 
that recently gained attention in a specific field. With our 
prognosis we follow the proposed combination of foresights 
with prognosis markets as described in [18]. 

Our results show that the integration of wearables in enterprise 
environments is still in its infancy. Our prognosis estimates the 
usage of wearables in enterprises until 2020 to nearly 20% (see 
Fig. 2a). The three most promising sectors (see Fig. 2 
Health Care, Transport & Logistics and Maintenance. 
shows that 15% of the production line experts will use smart 
gloves until 2018 in their daily business. We believe that expert 
assistance with wearables will be a key factor for efficiency 
and information transparency in modern industries. 


IV. PROBLEM STATEMENT AND USE CASE 


Horizontal as well as vertical information transparency 
and knowledge sharing is a main challenge in industries. 
Horizontal knowledge sharing refers to an organizational 
communication among different stakeholders at different 
locations. An example of such communication can be a 
domain relevant exchange of knowledge among. different 
production site managers at different locations. As within both 
production sites same components or even same production 
modules might be used, knowledge about known-issues or 
efficient processes can excel the output of a production 
site. Production sites can benefit from knowledge sharing 
in terms of predictive, real-time and historical knowledge 
monitoring. Vertical knowledge sharing is typically limited to 
one organization at a specific location, Knowledge exchange 
typically follows the defined hierarchical structures. 

Within industries different stakeholders are interested in 
knowledge such as Management Boards, Sales, Aftersales, 
Warehouse, Marketing, Preventive Maintenance, Purchasing, 
Maintenance, Setup, Operator and Quality Assurance [17]. All 
stakeholders should be interested in optimizing efficiency and 


performance. For that reason we claim that knowledge sharing 
and a transparent automatic documentation is inevitable to 
improve workflows, products and services. Data-integration 
and -aggregation of different systems, such as PLCs, DCSs 
and MESs, is important to generate new information and 
knowledge. Furthermore, the documentation of sensor or 
actuator replacements performed by production site experts 
is generally handwritten. Handwritten documentation can 
not be further processed and is not easily monitorable. 
Before implementing ILAS we defined a workflow that 
can prove the technical feasibility and correlates with a 
practical scenario, together with our research colleagues 
from the domain of automation and electrical engineering. 
As a result of our discussion we defined a three folded 
Incident Management Lifecycle (IML) (see Fig. 1) that 
of 5 steps: (1) Identification, (2) Localization, (3) 
Analysis, (4) Documentation and (5) Solution. Step (1) is 
done automatically by a Condition Monitoring System (CM) 
or manually triggered by an operator. A technical expert using 
a smart phone in combination with a smart glove performs 
steps (2) - (4). Step (5) is done by a technician not familiar 
with the specific production line or production site, He is 
only equipped with a smart glove. Our IML is covering a 
maintenance use case with an actual malfunctioning part, that 
will be replaced by a technician. 


V. INCIDENT ASSISTANCE SYSTEM - OVERVIEW 


‘The ILAS bridges the cyber and physical world (see Fig. 
3) and offers a transparent, real-time information monitoring 
and sharing. We combined different devices to form a Cyber- 
Physical Human System. To support a real-time monitoring 
with the goal to synchronize heterogeneous devices that form 
our CPHS we are using Message Queuing Telematic Transfer 
(MQTT) which has its roots in the domain of loT. Our CPHS 
offers a detailed and seamless documentation possibility 
during the entire incident process. 

ILAS consists of 7 subsystems. The Smart Phone, RFdunio, 
Intel Edison, ILAS Backend, MQTT Broker, Incident Data and 
the Admin Frontend (see Fig. 3). We implemented the Smart 
Phone application as iPhone application using Swift. The 
application is able to receive push notifications as soon as an 
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3: ILAS Deployment Diagram: Deployment diagram emphasizing the physical and cyber environment with the deployed 


devices. The dashed lines illustrate three different layers of abstraction: Notification mechanism based on MQTT (red), RESTful 
Services (brown) and a physical communication based on Bluetooth 4.0 (blue). 


incident has been assigned to the corresponding production 
line expert. The application offers the possibility to view 
similar incidents that are located in the same area and to take 
photos and notes during the analysis phase. All attached data 
stored in the Agile Factory App is instantaneously transferred 
to the ILAS Backend. Additionally, the expert using the smart 
phone can use a BLE based incident localization connecting 
the corresponding RFduino. 

‘The RFduino implements an ASCII based communication 
protocol to control the attached RGB LED Shield. The LED is 
used to visually mark the module where the incident occurred. 
‘As soon as the expert is close to the RFduino the localization 
mechanism on the Smart Phone and the visual feedback on the 
RGB LED Shield is automatically stopped. The localization is 
based on a RSSI based threshold mechanism. The extended 
ProGlove prototype (see Fig. 4) consists of a hardware button, 
an Intel Edison, a barcode scanner, a display, two LEDs and 
a battery pack. All the functionality is implemented using 
node,js in combination with MQTT and RESTful APIs. 
‘The smart glove supports two scenarios: the analysis and 
the replacement. During the analysis phase the smart glove 
can assist the expert. The expert can seamlessly check if a 
component is working properly. He scans the part (e.g. a 
sensor) followed by an API call sent to the /LAS Backend. The 
received response contains the information if the component 
is working properly. The smart glove visualizes the response 
using the integrated LEDs. In parallel, the scan process is 
published on a specific topic to the MOTT Broker. The Agile 
Factory App is subscribed to the defined incident ID topic. 
During the documentation, the information of the scanned 
components are seamlessly synchronized via MQTT on the 
smart phone and the Admin Frontend. 

Before the localization for the replacement phase starts, the 
expert needs to scan a barcode with his smart glove which 
can be printed on an invoice, an order confirmation or can be 
displayed on the experts smart phone. The barcode contains 
the incident ID. In case the incident ID is scanned, a RESTful 
API call is triggered to receive the corresponding Beacon 
ID from LAS Backend. In case the Beacon ID has been 


received, a Bluetooth low energy scan is performed. In case 
the Bluetooth low energy device of the corresponding module 
is in range, a connection is established to trigger the visual 
feedback on the RFdunino LED shield. Once a component 
(e.g temperature sensor) is scanned using the smart glove 
within the identified module, a message is published via 
MQTT. Additionally, the smart glove visualizes if the expert 
is scanning the component that needs to be replaced. As soon 
as the sensor has been replaced the expert scans the new 
sensor and finishes the replacement process. During the tasks 
all published MQTT messages contain the sensor identifier 
with the aim to keep the Admin Frontend and the Agile 
Factory App with the corresponding incident synchronized. 
‘The corresponding boundary conditions as well as the menu 
guidance process of the smart glove are not described in detail 
due to space reasons, The MQTT Broker has been implemented 


Fig. 4: ProGlove prototype in action: We integrated an 
Intel Edison board in combination with Bluetooth 4.0. We 
use node,js as platform on the device. The figure shows the 
extended ProGlove prototype. 


using the mosca® framework. The Administration Frontend 
supports the real-time monitoring and the administration of 
the incidents. Additionally, it offers the possibility to manually 
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trigger incidents. Also import and export functionality has 
been implemented to share common incidents. We claim 
that transparent information sharing, vertically as well as 
horizontally is a major goal to enable Industry 4.0 applications. 


VI. SUMMARY 


We describe the development of a  Cyber-Physical 
Human System (LAS) in the domain of manufacturing. 
For the requirements analysis we brought together electrical 
engineers, mechanical engineers as well as software engineers 
each synergizing with their domain specific knowledge. We 
are following the paradigm of interdisciplinary cooperation 
which we claim to be essential for applied industry related 
research. 

We defined an Incident Management Lifecycle that describes 
how incidents can be handled within a modern Industry 4.0 
conform factory. It combines a smart glove, a smart phone and 
Bluetooth low energy to support experts during all phases of 
the incident management process. Additionally, we conducted 
a foresight using the prognosis markets with three items. 
‘The goal is to estimate the potential of wearables within 
enterprises. Our results for the first item show that until 2020 
almost 20% of the enterprises will integrate wearables in 
their processes. For the second item the participants identified 
Health Care, Transportation & Logistics and Maintenance 
as the three most promising sectors. For the third item we 
defined three scenarios in which the participants had to 
estimate the usage of wearables until the year 2018. The 
results show that for the defined smart glove scenario (as 
implemented in this case study) 15% of the professionals will 
use wearables in their daily routines until 2018. 

We received first positive feedback from industries and 
could demonstrate the feasibility of the system design to 
our research partners and transferred ITSM knowledge to 
the domain of manufacturing. ILAS is implemented using a 
backend system, an iOS Application in combination with a 
smart glove and a web frontend. The backend is responsible 
for storing and validating data, synchronizing all included 
devices via MQTT and offering well defined interfaces. 
‘The iOS Application supports the technical expert during 
his incident documentation and localization in combination 
with the smart glove. For the smart glove we defined a 
Jean workflow and a one button based navigation. The web 
frontend supports live incident monitoring during all steps of 
the Incident Management Lifecycle. The incident information 
is therefore available to all stakeholders in a factory so that 
they can benefit in terms of information transparency. We also 
included a possibility to share incidents between different 
ILAS instances. 
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